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'""' Abstract 

o . 

^sl In this note, we demonstrate an instance of bounded-degree graphs of size n, for which the 

Vh total variation mixing time for the random walk is decreased by a factor of log n/ log log n if we 

, ^ multiply the edge-conductances by bounded factors in a certain way. 



m 



1 Introduction 



r— I Given a network G = {V, E), where each edge e G E is endowed with a conductance Cu,v > (the 

Ph default choice for Cu,v is 1), a (lazy) random walk on G repeatedly does the following: when the 

'; current state is f G F, the random walk will stay at v with probability 1/2 and move to vertex u 

'-^ with probability Cm,i,/(2 ^^^j, c^,„) for all u ~ u. Let -P*(-,-) be the transition probability for the 

^ random walk. Then the total variation mixing time with respect to starting node v is defined by 

ti (see [H [To] for more background) 

^ tmix(G, v) = mm{t : \\P\v, •) - 7r(-)||TV ^ \} , 

'^ where vr is the stationary measure for the random walk. Here \\fj, — i^Wtv = \ Z^xer? Ia'(-^) ~ ^(^)l 

(^ is the total variation distance between distributions v and ^ supported on Vi. We define the (total 

.^ variation) mixing time of the graph G by tmix(G) = max^,gy tmix(G, v). 

^^ In this note, we consider the sensitivity of the total variation mixing time when the edge 

f^ conductances are multiplied by bounded factors. We say a family of graphs {Gn} is robust if for 

. . every constant C > there exists a constant K > Q such that if we multiply the edge conductances 

.^ by a factor of at most G on these graphs, the corresponding mixing times are preserved up to a 

^ factor of K. Our main result is the following theorem. 

"^ Theorem 1. There exists a family of uniformly bounded- degree graphs that is not robust. Further- 

more, there exists a sequence of graphs {Gn} with maximal degrees bounded by 10 and \V[Gn)\ = n 
as well as a rule to change the edge- conductance up to a factor of 2, such that the total variation 
mixing times in Gn will change by a factor of at least c log n/ log log n, where c is an absolute 
constant. 

Our example in the preceding theorem is almost optimal (except for the log log n term) , due to 
the well known fact that A~^ ^ imix(G) = 0(A~^ log ^^^ ^^/ ■. ) (where ir is the stationary measure) 
and that the spectral gap A will be preserved up to constant under the aforementioned perturbation. 
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There are numerous works aiming at sharp geometric bounds on mixing times such as the Lovasz- 
Kannan bound ([H]) and the Fountoulakis-Reed bound [6] [7], where an upper bound on the mixing 
time is derived in terms of the expansion profile of the graph; these bounds on mixing times involving 
the geometry are robust under the conductance perturbation. Theorem [T] provides a cautionary 
note on the possibility of developing geometric bounds on mixing times, and implies that a tight 
(up to constant) bound for the mixing time of random walks on general weighted graphs cannot be 
robust under bounded perturbation of the edge conductances. 

In contrast with Theorem [T| many well-known families of graphs are robust. Robustness of 
general trees was established in [2]; some other examples are collected in the next proposition. 



Proposition 2. The following families of graphs are robust: (1) Tori {Z^ : n G N} for every fixed 
d € N; (2) Erdos-Renyi supercritical random graph Q{n,c/n) for a fixed c > 1; (3) Erdos-Renyi 
critical random graph G{n, 1/n); (4) Hypercubes {0, 1}". 

In view of Proposition [2| it is interesting to study how generally does robustness holds. Specif- 
ically, the following questions are open. 

Question 1. Are transitive graphs robust? 

A special and important class of Markov chains is the Glauber dynamics for spin systems. In 
this case, we could focus on perturbation of the updating rate: that is, instead of selecting a uniform 
spin to update, one selects each spin with probability of between ci/n and C2/n, where n is the size 
of the underlying graph and ci < C2 are positive constants. 

Question 2. Is Glauber dynamics for spin systems robust under bounded perturbation of the up- 
dating rate? 

One case where a positive answer to this is easily obtained is when the Dobrushin contraction 
condition is satisfied [I] (see also Theorem 15.1 in |10j). 

Finally, there are other notions of mixing times involving different distances between probability 
measures, one of which is the Lqo distance sup^,^gy \—^r^ ~ 1|- The robustness of the Lqo mixing 
time was studied in Kozma [9] , where he proved that Loo mixing time is preserved up to a factor of 
log log n. Our result can be seen as a complementary result to [9]. Note that geometric bounds on 
Loo mixing times have also been developed. In Morris and Peres |12j . it was shown that the Lovasz- 
Kannan bound is also effective for Loo mixing time, and [T^ was improved by Goel, Montenegro 
and Tetali [8j using spectral profile (as opposed to expansion profile). 

2 Constructions and proofs 

Our construction is based on two simple observations. First, by changing the conductance up to 
a constant factor, one could drastically change the harmonic measure (this idea was used before 
by Benjamini [3j to study instability of the Liouville property). Thus, one could then decorate the 
graph in a subset of vertices to incur a delay for the random walk such that the delay will differ 
significantly before and after changing the conductances. Second, the hitting time in one graph 
can always be translated to the mixing time for a larger graph. So the sensitivity of hitting times 
results in the sensitivity of mixing times (on a larger graph) . 

We now describe the construction of our graphs. We start with a simpler construction which 
gives a factor of ylogn for mixing times under a certain perturbation. First take a binary tree T 
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Figure 1: On the left, the balanced nodes between levels K/A and K/2 in a binary tree of depth 
K are decorated with 3D tori of volume K. This yields T^ and we add an expander G* of volume 
K^2^ . On the right, a binary tree of depth K is decomposed into numerous binary trees of depth 
i, and those between levels K/4: and K/2 are replaced by copies of T^ , and then an expander is 
added as before. 



rooted at o of height K. We distinguish the two children of a parent by left and right child. Denote 
by L and R the collection of left and right children in T, respectively. For i £ [K] := {!,..., K}, 
denote hy Hi C T the collection of vertices in the i-th level. For u,v S T, denote by r„^^ the 
collection of vertices that are in the unique path between u and v. Define 

B = {w£T : K/A ^ \ro,w\ ^ K/2, and | \To,w n L\ - \To,^u n R\\ s^ Vk} 

to be the collection of balanced nodes in T. For every u £ B, we attach a 3D torus Bu of volume K 
to u. That is to say, u G Bu and BuOT = {u}. Furthermore, BuDBuj = for u ^ w. Denote by T^ 
the graph obtained at this point. Finally, we attach a 3-regular expander of size K^2^ to the set 
of leaves Hk in T. That is to say, we attach an expander G* = {V* , E*) such that V* n T^ = Hk- 
We denote by Gi = (Vi, Ei) the final graph obtained from our construction. 

We will only give a sketch for the mixing time comparison for Gi, as a more detailed analysis 
will be given for a more delicate construction below. It is not hard to see that the mixing time on 
Gi should be at least the hitting time from the root to the leaf set in T. This is because when the 
random walk on T travels down from the root it typically visits at least i^/100 balanced points, 
the attached 3D torus will cause a delay on the hitting time by a factor of K. That is to say, the 
hitting time is at least of order K^, and so is the mixing time. Now, if we change the conductance 
on every edge (u, v) £ T with v £ L to 2, the mixing times will still be governed by the maximal 
hitting time to the leaf set. Also, the starting point which maximizes the aforementioned hitting 
time should be a node in a 3D torus attached to a balanced node deep inside the tree, such that 
the random walk on T will typically spend time 0{yK) at balanced nodes before reaching Hk- 
Thus the hitting time of Hk in Gi is 0{K^''^) (so is the mixing time). This shows that the mixing 



times will differ by a factor of order y^log |yi|, completing the sketch. 

Main construction. We construct the family of graphs which achieves the factor of log nj log log n 
as stated in Theorem [T] Again take a binary tree T rooted at o of height K. Write i = 100 log -R', 
and define Ti = Li -Ij^/^^Hji. For v ^ Ti, let Ty be the complete binary subtree of T rooted at v of 
height i. For each v £ Ti, define 

Ay = {weTy: e/4 ^ |r^,^| ^ e/2, and ||r^„,^ n L| - |r^,^ nR\\!^VI} 

to be the collection of balanced nodes in the subtree Ty. Denote by ^ = Uy^y^Ay. For every u G A, 
we attach a 3D torus Bu of volume K to u. Finally, we attach a 3- regular expander G* = {V*, E*) 
of size K^2 to the set of leaves Hk in T. We denote by G = {V, E) the final graph obtained from 
our construction. Note that \V\ = (1 + 0{l/K)){K'^2^) (with room to spare in 0{l/K)). 

Now we specify a rule of changing the edge conductance in G in order to obtain a new network 
supported on the same edge set as G. For every edge (n, v) £ T where n is a parent of v, we 
let the new edge conductance Cu,v = 2 ii v G L. The conductance of all the other edges in G is 
preserved. We denote by G = {V, G) this weighted graph (or network). At this point, we completed 
the construction of our examples, and it remains to verify the mixing times on G and G differ by 
a desired factor. 

Lemma 3. The mixing time on G satisfies tmix(G') ^ cK^ for a certain constant c > 0. 

Proof. Let r be the hitting time to the set V* for a random walk (St) on G. We wish to bound 
EqT from below. Let G' be the graph G without attached 3D tori. First, we consider a random 
walk (S[) on G' . Denote by iV, the number of times that (S*^) visits HiCiA before hitting V* , and 
denote by AA = ^- Ni. Clearly (5^) visits at least one vertex in every Hi before reaching Hx- By 
symmetry, we obtain that 

for a certain constant c > 0. Note that (St) can be decomposed to (S'f.) and the excursions performed 
in the attached 3D tori. Recall a standard fact that the expected return time to the origin of a 
random walk is the total volume normalized by the degree of the origin. Thus, every time (St) 
visits some v £ A, the average time it takes the random walk for the excursion in By is at least 
K/2 (and the length of such excursions are independent of the random walk on G'). Therefore, 
we have EqT ^ EqM ■ K/2 ^ cK^/2. Let v* be such that E„*r = maXjigyE^r. Thus by Markov 
property, we have 

Ey*T ^ cK^ /20 + Fy* (r ^ cK^/20)Ey*T , 

which yields that 

Fy,{T^ cK^/20) ^ 3/4. 

Since the stationary measure on V* satisfies that 7t{V*) ^ 1 — 1/K ^ 9/10 for large enough K, we 
obtain that tmix{G,v*) ^ cK^ /20, as required. D 

We now turn to analyze the mixing time on the network G. 

Lemma 4. The mixing time on G satisfies imix(G) = 0{K log K). 



Proof. We first show that tjnix(G', v) = 0{K) for ah v ^V* . Let r* be the stopping time at which 
the random walk has visited V* for CK times, and denote by tu the hitting time of a f7 for [/ C y. 
Note that P„(t//^^p < ry*) ^ e"^^ for all v ^V* and a certain c > 0, where -fTtop = U^^Y -^i- This 
implies that the random walk will not hit A before r* except with exponentially small probability. 
Also, on the rare event that the random walk does hit A, it only increases the stopping time r* 
by an additive term up to 0{K^) on average. Thus, we have E^r* = 0{K). Next, denoting by 
V* = V* U Vjf^^j^i^Hi, we see that the random walk stays within V* with probability at least 

1 — e~ . In addition, the majority (above 9/10 when K is large) of the stationary measure is 
supported on V* (and thus also on V*). Therefore, the mixing time for the whole network is 
bounded by the mixing time of the induced sub-graph G* on V* from above up to a multiplicative 
constant. Furthermore, since the induced subgraph G* is also an expander, we have imix(G*) ^ GK 
for a finite constant G. Altogether, we have shown tmix(G, i;) = 0{K) uniformly for all v ^V* . 

Denote again by r the hitting time to V* . In light of the above discussion, it remains to bound 
maXijE^T. Analogous to the proof of Lemma p| we consider a random walk {S'^) on G", which 
is the network obtained from G by ignoring the attached 3D tori. Suppose (5j) started at some 
V G Hk n T^ where w £ Ti. Note that before hitting V*, the expected number of times that {S[) 
visits Hk-j is 0{e~'^^) for a certain constant c > (as the random walk is biased toward the leaves). 
Therefore, the expected number of times that (5^) visits vJi^^Hi is 0(1). Also clearly, the expected 
number of visits to each Hi is 0(1), thus the expected number of visits to \T.u,\ is 0{\ogK). Next, 
for u G ^ \ U^^^ifj, we try to bound A^^j which is the number of visits to T^ n ^ before r. Observe 
that E^A^u = IPj;(tm < t)¥.u{Nu)- In addition, by a simple application of large deviation principle, 

t 
E„A„ ^ 0(1) Y, IPd^il ^ ^) = 0{K~^) . 

where Zi is a sum of i independent Bernoulli variables (taking values ±1) which has bias 1/6. 
Therefore, we obtain that (denoting by N the total number of visits to A before r) 

E^AA < 0(log K)+ Y^ E„ A„ ^ 0(log K) + KO{K-^) = 0(log K) . 

This implies that for the random walk on G, we have E^r = 0{K\ogK) uniformly for all v £ T. 
Since the maximal hitting time for a 3D torus of volume K is 0{K), this yields that max^gy K^t = 
0{KlogK), completing the proof of the lemma together with the fact imix(G', w*) = 0{K) for all 

V* e V*. D 

Proof of Theorem [7| Combining the preceding two lemmas, we obtain a ratio of order log n/ log log n 
for the mixing times after the perturbation of the conductances, thereby completing the proof of 
Theorem [TJ D 

We remark that a slightly more careful analysis would lead to a ratio of order log n/\/log log n. In 
addition, by iterating the aforementioned construction, one could obtain a ratio of order log n/ log^-^^ n 
for any fixed j E N, where log'-'^ n is the iterated logarithm of order j. 

Finally, we provide a proof of Proposition [2| which are simple consequences of known results. 

Proof of Proposition [2j (1) Torus Z„: the upper bound Gdn'^ can be deduced from Lovasz- 
Kannan bound ([llj) which is robust, and the lower bound CdTi^ is given by the inverse spectral 



gap, which is also robust. (2) Erdos-Renyi graph in supercritical case: the upper bound O(log^n) 
is given by the robust Fountoulakis-Reed bound ([SI [7], see also [3]) and the lower bound is due to 
the fact that there is an induced path of length 0(logn). (3) Erdos-Renyi graph in critical case: 
the upper bound 0{n) is given by the maximal commute time ([13j) which is robust, while the 
proof of the lower bound in [13] is also robust. (4) Hypercube: the upper bound 0(n log n) is given 
by the log-Sobolev constant (see, e.g., |5]) which is robust. For the lower bound, one could employ 
the coupon collecting argument. Note that after changing the conductance, the random walk does 
not update each coordinate in a uniform rate. Instead, each coordinate will be selected to update 
with probability of order 1/n. Therefore, there exists a constant c > such that after en log n steps 
the random walk started at has at least ^ -j-n^'^ O's with high probability. Since in the stationary 
measures (for both original hypercube and after perturbation) such configurations have negligible 
probability, this implies that the mixing time is larger than en log n. D 
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